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ABSTRACT 

The purpose of this study was to develop and field 
test a needs assessment procedure based on magnitude estimation 
scaling. The goal was to provide ratio scale expressions of the 
relative importance of school objectives by pertinent subsets and the 
total sample of school patrons, A patron-assembled set of 40 goals 
was evaluated by 132 fathers and 173 mothers of students and 15 
faculty members from the participating school. The results verified 
the strength of the procedure. Proportional relationships (judged 
evaluation by patrons) between goals were developed for the total 
sample and sample subgroups, (Author) 
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TJio intent of this piipev is to present a scaling technique 
known as iiiapjiitucle estimation scalinj; and iliustrnte :its use in 
needs assessment studies, This work was done at and supj^ortcd 
by Stanford lk'»scarcli institute. It was based on earlier work 
at tlie Institute conducted by i)r. Tor Meeiand. A limited number 
of copies of the full report of tlris project are still available 
and can be obtained by contacting Dr. Philij) Soi^cnscn, SRI, 
355 Ra\'ons\';oo(l, Menlo Park, California 9^1025. Ask for Patron 
Assessment of School Object ive s for M School , July 15, 1973. 

Currently, there is little utilization of this scaling 
technic[uc in educational research. However, since the 1940*s, 
considerable effort has been cx])ended in the area of psychopliysical 
research to develop scales involving the various senses. Most 
notcworth}' previous work was the development of the decibel scale 
in the area of liearing.-^ Recently, arguments claim that the 
procedures used in psychophysics , ~ including cross-modality 
matching, show a remarkable consistency when applied to such 
diverse phenomena as preferences for watches, occupations, 
odors, ^ the importance of monarchs,^^ the degree of frustration 
and aggression in a military setting, and the scaling of 
seriousness of delinquent offense::/ 

The essence of magnitude scaling is contained in the 
proportionality that is judged to exist among the various items 
under consideration. Whereas category (or confusion) scaling 



requires the assijininciit of an item to one of several catei',ories 

(7, 9, or 1.1, ts'pJcalJy) assumed to be sj)aced ec(ually cilon[; a 

continuum when in fact they are not, magnitude estimation scalinj^ 

rec|uij*es the assessmeiit of the amount alcove or below tlie standard 

that an attribute of an item has, NaturalJy, tlie standard (or 

reference) item and otlier items are ]n'esentcd in random order 

to avoid any systematic influence on the outcomes. Furthermore, 

item weights arc computed on tlic I)asis of geometric, not arithmetic, 

means since it has been observed that the variability of magnitude 

estimations tends to increase in proportion to the magnitude and 

2 

that the distributions are log norma]. If magnitude estimation 
scaling results are compared with category scaling, a curvilinear 
relationship is observed wliicli vanishes w^heii log-log coordinates 
are used, indicating tlie presence of a power function. 

Other tlian for psychophysics , the most extensive use of 
magnitude estimation scaling occurred in a three year study of 
crimes reported by Scllin and Wolfgang in which the judged 
seriousness of crimes was cstablislicd and additive weights for 

o 

various crimes were developed. Recently, tlic technique of magnitude 
estimation scaling was ai)plied by Meeland and Kaplan in the realm 
of insurgency to define the judged seriousness of terrorist- 
initiated acts of violence and the importance of tlie counter- 

9 

insurgents' suppression activities. 

In spring 1975, SRI queried tlie several State Departments 
of Education asking for instruments and guidelines used in needs 



assessment and scIioeUs involved in needs assessment programs. 
Responses from nearly fort)' stat:cs and several cities within 
these states were received l)y mid-April, 1973. A ])crusal of the 
res])onses indicates tluit development of tools and procedures 
lags tlie demiind I'or tlieso ]nx>ccdures. There is a need for 
procedures based on a uniform core of educational objectives 
which ])rovide information for all decision levels within a defined 
area and yet which maintain so:ne flexibility so that each scliool 
can secure adequate information suited to the local needs. 

In an effort: to dcveloj^ such procedures, SRI cooperated 

with administrative faculty and parents at M school in a 

needs asscs:>mcnt study, M school is a primary school consisting 

of grades K through third. 

SRI provided a committee of faculty and parents with a set 
of statements of educational objectives that were designed for 
elementary school. The committee was free to alter this list in 
any manner that it so desired. Since the third grade is the top 
grade in this scliool, the committee chose to- make several changes 
by deleting some objectives, rewriting most of the others so 
that they were appropriate for the limited grade range of the 
school, and adding other objectives as they saw fit. SRI made . 
a limited number of editorial changes in the statements of 
objectives to made them more behavioral in nature and consistent 
in style. Care was taken so as not to change the intent of tlie 
objectives. The final statement of objectives as produced was 
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submit totl to and aj^jM'ovod by the coi^iinlttcc . 

The l-ollc)wi]i{» is aji outline of the obj octi. vos covered 
I. Rcad:infi 

1 , Ap])rcc.iation 

2, Skill 

3 , I'ndcrstandint; 

^ if 

1 T . Ma Vh cilia t .'es 

1. Skin 

2. lit j 1 Ization 
in . Lant»uage Arts 

1 . Usage 

2. Lis*tciiing Skills 

3. Speaking Skills 

4. Writing Skills 

5. Study Skills 
IV. Affective 

1. School Attitude 

2. Self Concept 

3. Outside Interests 

4. Achievement Motivation 

5 . Personal Tein]:)eramont 
G . Attitude J Social 

7 . Attitude^ Ethnic 
V. llcaltli Physical Hducation 
1. Health, Safety 



2. IMiysicnl Liducat.iori 

3 . Sjx)rl:snuinsh.i p 
VI . Coiuiitivo 

1 . Kiiowlediic 

2. Uiulcrstaiulini; 
5 . Api>J i cat .ion 

4. ProbJcm Solviiii', 

5. Creativity 

6. Jucli;inoiit 
VII. Science 

1. Harth Science 

2. Biology 

5. Biology, Drugs 
4. Physical Science 
VIII. Social Studies 

1. Family Life 

2. Anthropology 

3. Hcology 

4 . Economics 

5 . Geograpliy 

6. I Li story 

7 . EmiD] oyment 
IX. Art 

X. Music 
XI . Foreign Language 



The iiKiJor j^ruupiiiiiS of those ol)jocl'ivcs and tlu? one or two 
word iclentifior as:u)cJatcd with each objective were provided 
by SRJ after the data for tliis report were collected. This was 
done to J'acilitato data reduction and rci^ortin^, and could not 
influence the resi)ondenfs * reactions to the objective. 

The style in presenting each objective is illustrated by 

the objective for reading apj)reci ation. 

UPON COMPUrflON OF M_ SCHOOL (:^\U^ GRADJ:}, IT IS I)IiSIR>\nLIi 
THAT AS A RHSULT Of SCIlOOl/ MO^ST CIULDRIiN 

Have an appreciation for reading. 

Examples (t)icy do at least some of tlic follovdnt;) : 

Select reading materials to read for cnjo>T.icnt. 

Select reading riaterials for study. 

Use reading as a way to solve a problem. 

Read in order to learn how to do something new. 

Read to learn about current events. 

The final instrument included a cover statement from the 
principal, directions for iMting the objectives, and a brief 
one page questionnaire. One unique aspect of tliis instrument 
was that the listing and printing of the objectives was done 
under computer control. For each printing, the order of the 
objectives was randomized. In all probability, no two parents 
in the population received the objectives in tlie same order. 
This ])rocedu]*e also randomizes tlic reference items since the first 
item in the list is tlio reference item for each • respondent . 

The materials were assembled with enough materials for two 
respondents in each package. One package was sent home witli the 
oldest child from eacli family. Consequently, all third grade 



students took homo ono i)ackot. All. other students in grades 
kinderiiarton throujih second, took home one packet only if they 
did not have an oJdoi* sibling in the same school (e.g., if a family 
had a child in kiiulei'gavUin and one in second grade, the second 
grade child took a j)acki t liomc but the ki ndei\unrten child did 
not). The coiiimittee had decided tliat respondents should not be 
identified so individual form nunil)ers were not recorded. Form . 
numbers, In' classrooms in which the packets were passed out, were 
recorded. . Consec|uently, each respondent could be associated 
Kitli the grade level coritaining the oldest cliild from a given 
family. 

In the scaling procedure known as magnitude estimation 
scaling, tlic concern was not with the absolute value or ranked 
position assigned each objective by the respondent, but was witli 
the ratio of the distances between tlie ratings of each objective 
by each res])ondent. 

Each respondent assigned a value to each ol^jectivo by comparing 
cacli objective to a randomly selected reference objective wliich 
was assigned a value. For example, the randomly assigned objective, 
Y-2 Physical Hducation, had an assigned value of fifty. The 
resjKjndont compared all other objectives to tliis one. If a given 
objective was judged twice as imj)ortant by tlie respondent, lie 
assigned it a value of one liundred. If he judged it was one half 
as important > he assigned a value of twenty-five. If the respondent 
thought reading skills, objective 1-2, was tliree times as important, 



ho assiiinod the value of one Innulrod fifty f.o tlial object:! vo, 

It was (lcsh\'il)]c that tlie rci'orcnce objective wiis randomly 
selected for each rosi)ondent. It did not matter if the same 
value was assi.qjiod to each referent^ Jiowover, in tliis study a 
value of fifty was assii;ncd to each. It was essential that the 
res])ondent exj)ress tJ)c relative importance of each objective as 
it related to the referent. The average of these relationships 
was best expressed by comjniting the seomctric mean of the values 
assigJied each objective by all 3*cspondcnts . These geometric 
means not only expressed the raiik position of each objective but 
the relative distance between each objective. An objective with 
a geometric mean of 6A was judged to be twice as important as 
an objective with a geometric mean of 32. 

Lack of time and funds have prevented us from doing all 
statistical procedures that are of interest to this project. 
For example, we do not report statistical significance of observed 
differences. Moreover, there is no attempt to interpret these 
findings as a sample of a larger population. This is, rather, 
a description of tlic rcsj-jonses of a total population defined as 

parents of children in M school who responded to this survey. 

Over 501) of available j^arcnts responded. 

Apparent practical differences were important to those 
concerned with school policies and programs. These practical 
differences can be defined as differences that could influence 
school policy. Such differences can only be judged by policy 



makers wlicii all iiiflucncJii^', ('actors ai'c coiisiclcrcd C^'C., biulfict, 
staff). Other di f forciicos wore of Interest l)ut had little to 
do witli policy. I'or cxani])lc, female i)arciits rated reading more 
than 50u hi^:hcr than did male parents. Sucli knowledjjo may hcl]i 
in dealini^ wLlI] parenls but ma}' be of litlle value in curriculum 
planning;. However, the fact that jxirents rated languaj;c arts 20^u 
hij'Jicr than did facility may have sifjilficant implications. 

The limitations of this pai)er do not permit presentation of 
the tabuiar data. lloWcvcr, some of the fir.ures derived from these 
data wi]] be presented for illustrative purposes. 

Since the faculty was a small grou]i (fifteen), it was not 
further subdivided. The parents comprised a mucli larj^er grouji of 
over three hundred respondents and was subdivided on variables 
such as sex, age, years of education or various perce])tions about 
the educational scene. 

A statistic labeled ^'Special Hmphasis Value'' was compiled. 
The first item on the questionnaire asked the respondent ''...above 
what number do you consider the objectives so important that the 

objectives should be given sjiecial emphasis at M school?" 

The objective evaluation score was comjnited for this item. The 
companion item on tho questiomiairc seeking tliose items of little 
or no value is not indicated in this report. The values here 
were so low that in all cases, all objectives were above this point. 
Apparently all objectives liave some value for M scliool. 

It is known that the plot of the raw data collected from 
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tlio n'S]Hiiulfnts is curv.i liiKvir in naiuro ami that the lui;ajvltlims 
of the responses is iiiesi nearly linear in nature, Therefore, the 
stamlanl deviation of the loj^arit lii:is was coin])Ulecl for each i^ojnilation 
category as the ap))]*o]uvi ate statistic to express sjircad or dispersion 
of ti)e scores. Tlu-. spread in the scores is related to the level 
of a;;reeiiienl amon^u tlie ineinbcrs of a {^rou]). If all iiicnbers of a 
jironp aiL^ree on a score i^lacement , then tlie sjiread Kill bo small*. 
A low standard dcviatioji indicates a hiijh level of a^jrecinent among 
resj)ond(Mit s and conversely, a lush standard deviation indicates 
a relative lack of at;reement anionv^, tlic respondents. The two groups 
of };rcatest interest to tliis rei)ort are faculty and ixironts total. 
I'or tliese two groups, the mean and tlic standard deviation of the 
agreement scores were coinjiuted witli tlie following results: 



The difference between the two means was not statistically 
significant Ct=^1.6l)). Ke cannot conclude the3*efore, that the 
faculty were in closer overall agreement than were the parents on 
the evaluation of the full set of objectives. 

Two ty])es of figures were ]n*epared from the data. In the 
first set, all objectives were disjilayed for major sul)sets of 
res])ondents . Figure 1 shows how all parents evaluated all objectives 
and figure II presents similar data for faculty. 

In all figures, tiie mean for the o])jectives in each classi- 
fication is indicated l)y a crossl)ar. The crossbar rejiresents the 



Mean 



S.I). 



Parents .550 
Faculty .451 



.090 
.202 
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Objective rivnliKitioii Scores 
Parents Total Distril)Ution 




Vigurc 11 Objective Hv.'i J nation Scores 
J'acuJry TotaJ Distribution 
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value for tlic major hoaJiiig. The objectives are grouped under 
tlic major licadings and are keyed to the listing prosejitcd earlier. 
The major licadings are arranged in descending order as evaluated 
by total parents. This order is preserved in other presentations. 
Tlic broken Jino indicates the special cmpliasis value as detoriuined 
by parents. 

Figure 1 shows how total parents evaluated all forty 
objectives. Reading objectives arc clearly the most important 
with reading skill being tlie highest ran];ed of all objectives. 
Matlieinatics objectives, as a group, rates a close second with 
mathematics skills ranking second only to reading skills. 
Language arts objectives, as a group, rates next. The third 
x^anked single objective, however, is **self concept*' in the 
affective group. Two of the objectives in the affective group, 
3 (outside interests) and 7 (attitude, ethnic) , are far below the 
others. Self concept is judged as nearly twice as important as 
eitlier of these two. Except for these two low ranking objectives, 
the affective group would have ranked higher than the language 
arts group. The other major categories in descending order are: 
V Ilealth--Physical Education, VI Cognitive, YII Science, 
VIII Social Studies, IX Art, X Music, and XI I'oreign Language. 

Several objectives are above the broken line. These were 
judged by the parents as deserving special attention and include 
t)ie following: 
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1 . ■ Road i 11 J.; 

1. Ai)]vroc.iatian 

2. Skill 

3. Understanding 
II. Mathematics 

1, Skill 

2. Utilization 

I' 

III. Language Arts 

1. Usage 

2. Listening Skills 

3. Speaking Skills 
S. Study Skills 

IV. Affective 

1. School Attitude 

2. Self Concept 

4. Achievement Motivation 

5. Personal Temperament 

6. Attitude 

V. Health and Physical Education 
1. Health, Safety 

3 . Sportsmanship 

Figure 11 sliows how the faculty responded to the total set 
of objectives. It is clear that although the pattern is similar 
to parents, there are some distinct deviations from the pattern 
resulting from parent resj^onses. 

The special cmj^hasis value is nearly the same for faculty and 
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parcnts but the objectives ijicliulcd within this area are different. 
The faculty would exclude from speciaJ enipliasis: 

Reading 113 Understanding 

Language Arts 111 Usage 

Language Arts u5 Study Sk:ills 

Physical Hducatioii Ifl llcaltli and Safety 
The facilty would include Cognitive US (creativity] as deserving 
special attention. 

Tlie second type of figure demonstrates how particular 
sub groups respond to pai^ticular objectives. The responces 
to the reading objectives are presenteol hero for illustrative 
purposes. » 

Figures 111 through IX show plots of objective evaluation 
scores for reading. Objective //2 (skill) raiiks liigiiest for ail 
groups. For most all parent groups, the "skill** objective is 
considerably hjgher than the next ranking reading objective. 
For total parents, Reading H (appreciation) ranks more than 20% 
lower than Objective ill (skill). Only the faculty (Fig. Ill) 
and parents who did not graduate from secondary school (Fig. V) 
rate aj^preciation nearly as high as skill. ^ 

Figure III sliows that males rate reading more than one-third 
lower in evaluation score points than do females. In Figure IV, 
it will be noted that older parents place increased value on skill 
and appreciation but not on understanding. . The young parents (those 
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Fifjure VJ READING ObJF.C iIVL: EVAiXATION SCJ^'^:S 
PARENTS m FAMILY CONFIGURATION 
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FiRuro VII REAKllG OrJiiCllVi:; EVAUlA'ilO!'; 3C0!tES 

PAR}iinS AC'UVI'K LIWEL IH SCHOOL AFFAIRS 
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r:inuro Vlll ULA'ljO 0;g;:i:'il\T:: EV/\Ll;A'iiOj: SCOiiKS 

l^Aib;KTS GROUPED Wi Ilim PHlUCcJP'ilOKS OF 
Ql-ALirr OV LDUCA'ilON AT M 
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ill their twentios) arc tlio only suhp.rou]) of i)arc)its who vtilucci 
uiulcrstniul i Ji^i; above appi'cciation. In }>ojiera.l, tlic following 
parents tend to rate roacli.ny hi^^her than other parent [irouj^s: 
I'ornales CIMj;, 111), oJdcr parents (I'lj;* IV) ^ parents with some 
post secondary school (I'i.i;, V), ])arejits wi.th older chi.ldj'cn in 
school Vi), parents active in school affairs (Fifi. VII), 

and j)aronts wlio are dissatisfied witli tJic ([uality of educatioji 

Vlli). Almost all i)arcnt groui)s excoi)t fatliers (Pig. Ill) 
and people not active in school affairs (I-ij;. VII) rate reading 
higher than docs the faculty (Fig. HI), 

I have ])resejitcd oJie other figure to illustrate how striking 
some infoiMiiation may appear. The parents added one ol)jective on 
drugs to the science group. The behaviors listed were: 

Describe some effects and results of drugs such as asjvirin, 

caffeine, alcohol, or tobacco. 

Know how to make a decision al)out wlien to take medicine 
and from whom. 

Figure X indicates liow parents and faculty responded to 
all science objectives. The curriculum im])licat i ons in this 
information seems self evident. 

There are certain rclativel) consistent resj^onse patterns 
tliat become eviden*- as the various subgroups in tlie po]nilation 
arc examined. For example, faculty ratings are slightly lower than 
tliosc for total parents. However, male parents usually gave 
slightly lower ratings tlian faculty ratings,. F'emale parent 
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riitings (irc substanl lii 1 1)' hiyher tluui iiuilo ]\itings. There were 
about forty more i'ciiKiJus than iiiaJes in the sample, If parent 
total had boon a weighted average of parent-male and i)arent-f cmale, 
tlie faculty and parent totcil .score would have been somewhat closer. 

Parent evaluat 'ons, when oxaj.iined b\' age groui)S, present a 
consistent pattern. There is a sliglit droj) :in values from the 
twenties tu the thirties followed by a significant rise through 
the forties and fifties and older age groups. 

The trend In olriective evaluation scores, as i)lottcd by 
years of education, presents a confused picture of erratic 
relationsliips . In terms of years of education, tlie score values 
drop from the eleven years or loss category to the twelve yeai's 
category, then take a significant rise for the thirteen, fourteen, 
fifteen years category, and drop again for the sixteen, seventeen 
years of education group. It may be that these groups are 
confounded by variations in age or sex membersliip within the 
groups. The data would permit such an analysis but it has not 
been undertaken. 

Parents with older children in the family rate most objectives 
Iiiglier than do parents with younger children in the family. 
However, it may be tliat tlie difference observed can be accounted 
for by age difference of the parents. 

Parents classified by activity level in school affairs do 
not present a consistent response pattern across the various 
objective groupings. 



Pai'eiitj? \<ho rate the quality of education as low arc small 
in number but dcviuto si. . Mcnntly from the rest of the group. 
Not only do they phice about 50^1> more cmi)has;is on most of the 
objectives, but in many cases tlK\>' tend to place the obicctives 
in a diffcrcnl. order or relationship. In language arts, they place 
writing at the top of tlie language arts objectives, while other 
groups place writing skills at the bottom of the list. In affective 
objectives, they place objective //5 (personal tem])eramcnt) and 
/M (achievement motivation) at the top of the lisr, while other 
groups assigned these objectives to a more central position. 

In cognitive objectives, this group assigned the objectives 
in a somewhat different order than the rest of the parents. In 
science, they did not choose to emphasize biology-drugs as did all 
otlier parent groups. 

In social studies, this same group of parents would place 
family life in fourth position while all other parent groups 
selected the top position for family life. One is led to wonder 
if this group thinks the quality of education is poor simply 
because their viewpoint on what education should be is so different 
from the rest of the ])opulation. 

In general, parents who rate the attitudes of children as 
poor, tend to place a lower value on most objectives than total 
parents. By contrast, parents wlio rate the attitudes as outstanding, 
tend to assign higher values to the objectives. 
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